IMAGING METHOD AND APPARATUS FOR GENERATING AN 
OUTPUT IMAGE WITH A WIDE DYNAMIC RANGE 
BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The invention relates to an imaging method and 
apparatus, more particularly to an imaging method and 
apparatus for generating an output image with a wide 
dynamic range . 

2* Description of the Related Art 

In a conventional imaging apparatus , such as a motion 
video camera or a still image camera, a light level 
coordinate of 1 indicates the lowest light level that 
can be detected and that is barely above the noise floor, 
whereas a light level coordinate of 4096 indicates the 
highest light level that can be detected and that is 
just at the brink of saturation. In other words, the 
widest dynamic range of a conventional imaging apparatus , 
which is defined as the ratio between the highest and 
lowest light levels that can be detected, is 4096:1. 
In binary form, 12 bits are needed to represent the full 
range of the light level coordinates. However, image 
output devices that are capable of processing 12 -bit 
light level coordinates are very expensive as compared 
to those capable of processing 8-bit light level 
coordinates due to their high precision requirement. 
As such, scaling down of the 12 -bit light level 
coordinates to 8 bits is usually performed to avoid the 



need for using expensive image output devices. 

On the other hand, scaling down of the 12 -bit light 
level coordinates to 8 bits results in a reduction of 
the output dynamic range from 4096 : 1 to 256 : 1 . The effect 
of the reduction in the output dynamic range will be 
explained in greater detail via the following example. 

Figure 1(a) illustrates a histogram analysis of an 
image output prepared according to the pixel data that 
constitute the image output and their corresponding 
light level coordinates, and under the assumption that 
an ideal imaging apparatus can capture and produce the 
entire wide dynamic range of light level coordinates. 
The X-axis of the histogram represents the 4096 light 
level coordinates, whereas the Y-axis of the histogram 
shows the number of pixel data associated with each of 
the 4096 light level coordinates. It is evident that 
the image output of Figure 1(a) has a low light level 
portion and a high light level portion. The dynamic range 
of this image output is beyond the control range of a 
conventional imaging apparatus. 

Figure 1(b) illustrates a histogram analysis of the 
same image output produced by a conventional imaging 
apparatus, wherein the 4096 light level coordinates are 
scaled down to 256. In the histogram of Figure 1(b), 
the imaging apparatus has a back light compensation 
feature to overexpose a scene so that details in the 
low light level portion can be reproduced. However, the 
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high light level portion is saturated, and details 
therein are lost, as indicated at the rightmost end of 
the histogram. 

Figure 1 (c) illustrates a histogram analysis of the 

5 same image output produced by a conventional imaging 

apparatus using standard auto exposure control , wherein 
the 4096 light level coordinates are also scaled down 
to 256 . In the histogram of Figure 1 (c) , details in the 
high light level portion can be reproduced, but details 

10 in the low light level portion are lost, as indicated 
at the leftmost end of the histogram. 

In U.S. Patent No. 5,144,442, there is disclosed a 
wide dynamic range video imaging apparatus. In this 
patent, a timing controller controls the duration of 

15 the exposure time of a camera so that a plurality of 
video images of a scene at different exposure levels 
can be obtained. An analog- to-digital converter 
converts the video images into digital video data, and 
a neighborhood transform processor performs 

20 neighborhood transform processing upon the video data. 
A combiner combines the processed video data to result 
in a combined video image that is stored in a memory 
device . 

A main drawback of the aforesaid video imaging 
25 apparatus resides in that multiple exposures of the same 
scene are required to generate the combined video image . 
As such, the technique is only applicable to video with 
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very slow moving objects because images from two 
different exposures taken at different time intervals 
are combined. This technique is not applicable to fast 
moving objects where fast exposure times are required 
5 to generate clear images. Further, full frame buffers 
are required for storage of the video data taken at 
different exposure levels so that combining of the video 
images can proceed, thereby resulting in a relatively 
large memory requirement. If multiple cameras are to 

10 be employed so as to generate the plurality of video 
images of the scene at different exposure levels and 
at the same time, the size and cost of the video imaging 
apparatus will be considerably increased. 
SUMMARY OF THE INVENTION 

15 Therefore, the object of the present invention is 

to provide an imaging method and apparatus for generating 
an output image with a wide dynamic range without 
requiring multiple exposures and a relatively large 
memory space for video data. 

20 According to one aspect of the invention, an imaging 

method for generating an enhanced optical image of a 
scene comprises the steps of: 

generating at least first and second optical image 
data corresponding to an optical image input of the scene 

25 taken at a single exposure, the optical image input 
having a wide input dynamic range with at least higher 
and lower dynamic range portions, the higher dynamic 
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range portion having an upper range limit that serves 
as an upper range limit of the wide input dynamic range, 
the lower dynamic range portion having a lower range 
limit that is lower than the upper range limit of the 
5 higher dynamic range portion and that serves as a lower 
range limit of the wide input dynamic range , the first 
optical image data having a dynamic range corresponding 
to the higher dynamic range portion, the second optical 
image data having a dynamic range corresponding to the 

10 lower dynamic range portion; and 

combining the first and second optical image data 
to result in optical image output data corresponding 
to the enhanced optical image of the scene. 

According to another aspect of the invention, an 

15 imaging apparatus for generating an enhanced optical 
image of a scene comprises: 

an image generating device for generating at least 
first and second optical image data corresponding to 
an optical image input of the scene taken at a single 

20 exposure, the 'optical image input having a wide input 
dynamic range with at least higher and lower dynamic 
range portions, the higher dynamic range portion having 
an upper range limit that serves as an upper range limit 
of the wide input dynamic range, the lower dynamic range 

25 portion having a lower range limit that is lower than 
the upper range limit of the higher dynamic range portion 
and that serves as a lower range limit of the wide input 
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dynamic range, the first optical image data having a 
dynamic range corresponding to the higher dynamic range 
portion, the second optical image data having a dynamic 
range corresponding to the lower dynamic range portion; 
5 and 

an image combining device, coupled to the image 
generating device, for combining the first and second 
optical image data to result in optical image output 
data corresponding to the enhanced optical image of the 

10 scene. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other features and advantages of the present 
invention will become apparent in the following detailed 
description of the preferred embodiments with reference 

15 to the accompanying drawings, of which: 

Figure 1(a) illustrates a histogram analysis of an 
image output prepared according to the pixel data that 
constitute the image output and their corresponding 
light level coordinates, and under the assumption that 

20 an ideal imaging apparatus can capture and produce the 
entire wide dynamic range of light level coordinates; 

Figure 1(b) illustrates a histogram analysis of the 
same image output produced by a conventional imaging 
apparatus having a back light compensation feature to 

25 overexpose a scene so that details in the low light level 
portion can be reproduced; 
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Figure 1 (c) illustrates a histogram analysis of the 
same image output produced by a conventional imaging 
apparatus using standard auto exposure control; 

Figure 2 is a schematic circuit block diagram 
5 illustrating the first preferred embodiment of an 
imaging apparatus according to the present invention; 

Figure 3 shows a series of histograms to illustrate 
the operation of the first preferred embodiment; 

Figure 4 is a schematic circuit block diagram 
10 illustrating the second preferred embodiment of an 

imaging apparatus according to the present invention; 

Figure 5 shows a histogram to illustrate how a wide 
input dynamic range is segregated into higher and lower 
dynamic range portions in the second preferred 
15 embodiment; 

Figure 6 is a schematic circuit block diagram 
illustrating the third preferred embodiment of an 
imaging apparatus according to the present invention; 
Figure 7 shows a histogram to illustrate how a wide 
20 input dynamic range is segregated into a plurality of 
dynamic range portions in the third preferred embodiment ; 
and 

Figure 8 shows a histogram to illustrate how a wide 
input dynamic range is segregated into a plurality of 
25 dynamic range portions in the fourth preferred 
embodiment of an imaging apparatus according to the 
present invention . 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Figure 2 , the first preferred embodiment 
of an imaging apparatus according to the present 
invention is shown to comprise an image generating device 

5 that includes an image capturing unit 10 and a pair of 
signal converters 14, 16, a control device 12, and an 
image combining device 18 . In this embodiment, the image 
capturing unit 10 includes an optical imaging lens 100, 
an image sensing unit 102 , and two video amplifiers 106 , 

10 108. The control device 12 includes a timing controller 
120, an image processor 122, such as a digital signal 
processor (DSP) , and a data storage unit 124. Each of 
the signal converters 14, 16 is associated with a 
respective one of the video amplifiers 106, 108, and 

15 includes an analog-to-digital converter (ADC) 142, 162, 
and an image buffer unit 14 6, 166. 

In use, the imaging apparatus will initially operate 
in a set-up mode. At this time, the optical imaging lens 
100 will generate an optical image input of a scene. 

20 The image sensing unit 102, such as a CCD, CID, CMOS, 
photodiode array, or any other visible or non-visible 
light sensor array, is coupled to the optical imaging 
lens 100 , andreceives the optical image input therefrom. 
The timing controller 12 0 , which comprises conventional 

25 clocks, counters and frequency dividers, is coupled to 
the image sensing unit 102, and controls the integration 
time of the same in a known manner. The image sensing 
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unit 102 consists of an array of pixel sensing cells, 
and generates input optical image signals corresponding 
to the optical image input sensed thereby. In the set-up 
mode, the video amplifier 106, which is coupled to the 
5 image sensing unit 102 , amplifies the input optical image 
signals from the image sensing unit 102. The ADC 142, 
which is coupled to the video amplifier 106, receives 
the output of the latter, and proceeds to convert the 
same into optical image data. The optical image data 
10 from the ADC 142 is received by the image processor 122, 
which is coupled to the ADC 142. Thereafter, the image 
processor 122 analyzes the light level coordinate 
distribution of image pixel data that constitute the 
optical image data from the ADC 142. Based on the light 
15 level coordinate distribution analyzed thereby, for 
light level coordinates distributed with a number of 
image pixel data that is above a predetermined light 
level threshold number (N t h) / the image processor 122 
determines an upper range limit (Riu) of a higher dynamic 
20 range portion (Ri) of a wide input dynamic range of the 
optical image input, and a lower range limit (R 2 d) of 
a lower dynamic range portion (R 2 ) of the wide input 
dynamic range of the optical image input, as shown in 
Figure 3. The upper range limit (Riu) of the higher dynamic 
25 range portion (Ri) is the largest light level coordinate 
distributed with a number of the image pixel data that 
is above the predetermined light level threshold number 
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(Nth) / and is also the upper range limit of the wide 
input dynamic range of the optical image input . The lower 
range limit (R 2 d) of the lower dynamic range portion 
(R 2 ) is the smallest light level coordinate distributed 

5 with a number of the image pixel data that is above the 
predetermined light level threshold number (N th ) , and 
is also the lower range limit of the wide input dynamic 
range of the optical image input. The image processor 
122 then determines a lower range limit (Rid) of the 

10 higher dynamic range portion (R x ) , and an upper range 
limit (R 3U ) of the lower dynamic range portion (R 2 ) such 
that a total number of the image pixel data having light 
levels that fall in either one of the higher and lower 
dynamic range portions (Ri, R 2 ) is greater than a 

15 predetermined pixel threshold number, e.g. 90% or more 
of the total number of image pixel data from the ADC 
142 . 

The higher and lower dynamic range portions (Ri, R 2 ) 
do not overlap. If the total number of the image pixel 

20 data having light levels that fall in either one of the 
higher and lower dynamic range portions (Ri, R 2 ) is less 
than the predetermined pixel threshold number , the light 
level threshold number (N th ) is decreased, and the upper 
and lower range limits (Riu, R2u# Rid, *2d) of the higher 

25 and lower dynamic range portions (Ri, R 2 ) are determined 
anew in the manner described hereinabove. As such, the 
condition that the total number of the image pixel data 
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having light levels that fall in either one of the higher 
and lower dynamic range portions (Ri, R2) is greater 
than the predetermined pixel threshold number can be 
fulfilled. In addition, image pixel data having light 
5 levels that do not fall in either one of the higher and 
lower dynamic range portions (Ri, R 2 ) can be adjusted 
to the lower range limit (Rid) of the higher dynamic 
range portion (Ri) or the upper range limit (R 2 u) of the 
lower dynamic range portion (R 2 ) . 

10 Upon determining the range limits of the higher and 

lower dynamic range portions (Ri, R2) , the image 
processor 122 stores range information associated with 
the higher and lower dynamic range portions (Ri, R 2 ) 
in the data storage unit 124. 

15 After operation in the set-up mode, the imaging 

apparatus is now ready for operation in an output 
image-generating mode. In the output image-generating 
mode, the optical imaging lens 100 will generate an 
optical image input of a scene. The image sensing unit 

20 102 receives the optical image input from the optical 
imaging lens 10 0 and, under the control of the timing 
controller 120, generates input optical image signals 
(Si) corresponding to the optical image input sensed 
thereby. The input optical image signals (Si) are 

25 provided to the video amplifiers 106, 108, 
simultaneously. Based on the range information stored 
in the data storage unit 124, the bias and gain settings 
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of the video amplifiers 106, 108 are adjusted by the 
image processor 122 such that the optical image signal 
output (S Ai ) of the video amplifier 106 has a dynamic 
range corresponding to the higher dynamic range portion 

5 (Rx) , and such that the optical image signal output (S A2 ) 
of the video amplifier 108 has a dynamic range 
corresponding the lower dynamic range portion (R 2 ) . 
Particularly, the video amplifier 106 processes the 
input optical image signals (Si) such that the input 

10 optical image signals (Si) that are encompassed by the 
higher dynamic range portion (Ri) will fall within the 
operating range of the ADC 142, which is coupled to the 
video amplifier 106. The video amplifier 108 processes 
the input optical image signals (Si) such that the input 

15 optical image signals (Si) that are encompassed by the 
lower dynamic range portion (R 2 ) will fall within the 
operating range of the ADC 162 , which is coupled to the 
video amplifier 108. The ADC 142 receives the signal 
output (S A i) of the video amplifier 106, and proceeds 

20 to convert the same into 8 -bit optical image data (S D i) 
that is stored in the image buffer unit 146. The ADC 
162 receives the signal output (S A2 ) of the video 
amplifier 108, and proceeds to convert the same into 
8-bit optical image data (S D2 ) that is stored in the 

25 image buffer unit 166, The image buffer units 146, 166 
are preferably line buffers to minimize memory costs. 
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The image combining device 18, which is coupled to 
the image buffer units 146, 166, retrieves the optical 
image data (S D i, S D2 ) from the same. The image combining 
device 18 combines the optical image data (S D i, S D2 ) to 

5 obtain optical image output data (S 0 ) corresponding to 
an enhanced optical image of the scene. As to how the 
optical image data (S D i, S D2 ) are combined by the image 
combining device 18 , this can be accomplished in 
different ways . For example, the optical image data (S D 2) 

10 corresponding to the lower dynamic range portion (R 2 ) 
can be scaled to 0-l27th levels, whereas the optical 
image data (S D i) corresponding to the higher dynamic 
range portion (R x ) can be scaled to 128-255th levels. 
Alternatively, the 0-255th levels can be divided 

15 according to the ratio of the ranges of the higher and 
lower dynamic range portions (Ri, R 2 ) . The optical image 
output data (So) from the image combining device 18 may 
undergo additional processing, such as edge enhancement , 
histogram equalization, compression logic, and 

20 encoding logic, before being provided to an image output 
device (not shown) • 

It should be understood that it is not necessary to 
operate the imaging apparatus in the set-up mode each 
time an output image is to be generated. Operation in 

25 the set-up mode can be initiated automatically after 
a period of time, in cases where the target object of 
successive output images remains still, and where there 
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is little change in the lighting conditions of successive 
output images. Conventional techniques can be employed 
to detect changes in the target object or the lighting 
conditions for alerting the user of the need to operate 
5 the imaging apparatus in the set-up mode at appropriate 
times . 

Through the use of the video amplifiers 106, 108 and 
the ADCs 142 , 162, the control range of the imaging 
apparatus of this invention can be broadened to cover 

10 an inherently wide dynamic range that is beyond that 
which can be achieved through the use of a single video 
amplif ier-and-ADC pair . 

In the embodiment of Figure 2, the optical imaging 
lens 100 is of an electronic shutter type, and is coupled 

15 to and controlled by the timing controller 120 in a known 
manner. Alternatively, the optical imaging lens 100 can 
be replaced by a mechanical shutter type that is manually 
operated to control the provision of the optical image 
input to the image sensing unit 102. 

20 Referring to Figure 4, the second preferred 

embodiment of an imaging apparatus according to the 
present invention is shown to also comprise an image 
generating device that includes an image capturing unit 
10' and a pair of signal converters 14' , 16' , a control 

25 device 12' , and an image combining device 18' . In this 
embodiment, the image capturing unit 10' includes an 
optical imaging lens 100' , an image splitter 101' , two 
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image sensors 102 ' , 104 ' , and two video amplifiers 106 ' , 
108 ' . The control device 12 ' includes a timing controller 
120' , an image processor 122' , and a data storage unit 
124'. Each of the signal converters 14' , 16' is 

5 associated with a respective one of the video amplifiers 
106' , 108' , and includes an analog- to-digital converter 
(ADC) 142', 162 ', a neighborhood transform processor 
(NTP) 144' , 164' , and an image buffer unit 146' , 166' . 
In use, the imaging apparatus will initially operate 

10 in a set-up mode. At this time, the optical imaging lens 
100' will generate an optical image input of a scene. 
The image splitter 101' , which couples optically the 
optical imaging lens 100' to the image sensors 102' , 
104 ' , will split the optical image input from the optical 

15 imaging lens 100' and will provide split optical image 
inputs to the image sensors 102 ' , 104 ' . The image sensors 
102', 104' generate input optical image signals (Sir, 
Si 2 ') corresponding to the optical image inputs sensed 
thereby. In the set-up mode, the video amplifier 106' , 

20 which is coupled to the image sensor 102', amplifies 
the input optical image signals (SuO therefrom. The 
ADC 142' , which is coupled to the video amplifier 106' , 
receives the optical image signal output (S A iO of the 
latter, and proceeds to convert the same into digital 

25 form. The optical image data (S D i') from the ADC 142' 
is received by the image processor 122'. Thereafter, 
the image processor 122' analyzes the light level 
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coordinate distribution of image pixel data that 
constitute the optical image data (S D iO from the ADC 
142' . Based on the light level coordinate distribution 
analyzed thereby, for light level coordinates 

5 distributed with a number of image pixel data that is 
above a predetermined light level threshold number (N t h) , 
the image processor 122 ' determines an upper range limit 
(Riu-) of a wide input dynamic range of the optical image 
input, and a lower range limit <R 2 d') of the wide input 

10 dynamic range of the optical image input in a manner 
similar to that of the previous embodiment, as shown 
in Figure 5 . 

The image processor 122' then determines a 
non-significant dynamic range portion (R D 0 between the 

15 upper and lower range limits (Riu'), (R2D')* The 
non-significant dynamic range portion (R D * ) is a dynamic 
range portion of the wide input dynamic range of the 
optical image input that encompasses a greatest number 
of consecutive light level coordinates distributed with 

20 a number of image pixel data that is below the 
predetermined light level threshold number (N th ) • 
Thereafter, the image processor 122' assigns an upper 
range limit of the non-significant dynamic range portion 
(RdO as a lower range limit (RduO of a higher dynamic 

25 range portion (RiO of the wide input dynamic range of 
the optical image input, and a lower range limit of the 
non-significant dynamic range portion (R D 0 as an upper 
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range limit (Rdc) of a. lower dynamic range portion (R 2 0 
of the wide input dynamic range of the optical image 
input . 

In the second preferred embodiment, in cases when 

5 the total number of image pixel data having light levels 
that fall in either one of the higher and lower dynamic 
range portions (Ri* , R2O fails to encompass a 
predetermined pixel threshold number, e.g. 90% or more 
of the total number of image pixel data from the ADC 

10 142 ' , the image processor 122 ' adj usts the predetermined 
light level threshold number (N t h) to reduce the number 
of non-significant light level coordinates in the light 
level coordinate distribution analyzed by the image 
processor 122 ' . The image processor 122 ' then determines 

15 a new non-significant dynamic range portion (R D <> based 
on the adjusted light level threshold number (N t h) . 
Adjustment of the light level threshold number (N t h) 
is repeated until the total number of image pixel data 
having light levels that fall in either one of the higher 

20 and lower dynamic range portions (Rr , R 2 0 encompasses 
the predetermined pixel threshold number. 

Like the previous embodiment, upon determining the 
range limits of the higher and lower dynamic range 
portions (Ri», R2O , the image processor 122 ' stores range 

25 information associated with the higher and lower dynamic 
range portions (Ri» , R2O in the data storage unit 124' . 
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After operation in the set-up mode, the imaging 
apparatus is now ready to be operated in an output 
image-generating mode. In the output image-generating 
mode, the optical imaging lens 100 ' will provide an 

5 optical image input of a scene. The image splitter 101' 
splits the optical image input from the optical imaging 
lens 100 ' , and provides the split optical image inputs 
to the image sensors 102' , 104' , respectively. At this 
time, according to the range information stored in the 

10 data storage unit 124 ' , the image processor 122 ' controls 
the timing controller 120' to vary, in turn, the 
integration times of the image sensors 102' , 104' . The 
purpose of varying the integration times is to provide 
an effect similar to the adjustment of the gain settings 

15 of the video amplifiers 106 , 10 8 of the imaging apparatus 
of the first preferred embodiment. The image sensors 
102' , 104' generate input optical image signals (Sir, 
Si2') corresponding to the split optical image inputs 
sensed thereby. The input optical image signals (Sir, 

20 Si2') are provided to the video amplifiers 106' , 108' , 
simultaneously. Based on the range information stored 
in the data storage unit 124' , the bias settings of the 
video amplifiers 106' , 108' are further adjusted by the 
image processor 122' such that the optical image signal 

25 output (S A i') of the video amplifier 106' has a dynamic 
range corresponding to the higher dynamic range portion 
(RiO of the wide input dynamic range of the optical 
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image input, and such that the optical image signal 
output (S A 2') of the video amplifier 108' has a dynamic 
range corresponding to the lower dynamic range portion 
(R 2 ') of the wide input dynamic range of the optical 

5 image input. Particularly, the video amplifier 106' 
processes the input optical image signals (Sil') such 
that the optical image signals (SuO that are encompassed 
by the higher dynamic range port ion (RiO will fall within 
the operating range of the ADC 14 2 ' . The video amplifier 

10 108' processes the input optical image signals (Si 2 <) 
such that the optical image signals (Si 2 ') that are 
encompassed by the lower dynamic range portion (R2O 
will fall within the operating range of the ADC 162' . 
The ADC 142' receives the optical image signal output 

15 (S A1 0 of the video amplifier 106', and proceeds to 

convert the same into 8 -bit optical image data (S D i<) . 
The ADC 162' receives the optical image signal output 
(Sa2') of the video amplifier 108', and proceeds to 
convert the same into 8-bit optical image data (S D 2<) . 

20 The NTPs 144 ', 164' are coupled to the ADCs 142' , 

162' , and receive the optical image data (S D i'# S D 2') 
therefrom, respectively. The NTPs 144' , 164' perform 
known neighborhood transform processing upon the 
optical image data (S D i<, S D2 0 to reduce low frequency 

25 components and to achieve edge and contrast enhancement . 

The processed image data from the NTPs 144' , 164' , are 
stored in the image buffer units 146', 166'. In this 
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embodiment, the image buffer units 146' , 166' are line 
buffers, the sizes of which depend on the neighborhood 
transform algorithm. 

The image combining device 18 7 , which is coupled to 

5 the image buffer units 146', 166', retrieves the 
transformed image data from the same . The image combining 
device 18 ' combines the transformed image data retrieved 
thereby in a manner similar to that of the image combining 
device 18 of the first preferred embodiment to obtain 

10 optical image output data corresponding to an enhanced 
optical image of the captured scene. 

Unlike the previous embodiment, the image processor 
122' is further coupled to the image combining device 
18 7 so as to provide the range information of the higher 

15 and lower dynamic range portions (Ri* , RaO of the wide 
input dynamic range thereto. The optical image output 
data from the image combining device 18 7 can include 
attribute information to permit reconstruction of the 
transformed image data therefrom. 

20 In actual practice, the light level coordinate 

distribution of the wide input dynamic range of an 
optical image input can be segregated into more than 
two dynamic range portions. Referring to Figure 6, the 
third preferred embodiment of an imaging apparatus 

25 according to the present invention is shown to comprise 
an image generating device that includes an image 
capturing unit 10" and a plurality (up to 10) of signal 
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converters 14", a control device 12", and an image 
combining device 18" . The image capturing unit 10" 
includes an optical imaging lens 100" , an image sensing 
unit 102" , and a plurality (up to 10) of video amplifiers 

5 1060", 1061", ... 106n". The control device 12" includes 
a timing controller 120", an image processor 122", and 
a data storage unit 124" . Each of the signal converters 
14" is associated with a respective one of the video 
amplifiers 1060", 1061", ... 106n", and includes an 

10 analog-to-digital converter (ADC) 1402", 1412", ... I4n2", 
and an image buffer unit 1406", 1416", ... 14n6" . 

In use, the imaging apparatus will initially operate 
in a set-up mode. At this time, the optical imaging lens 
100" will provide an optical image input of a scene. 

15 The image sensing unit 102" receives the optical image 
input from the optical imaging lens 100" . The timing 
controller 120" is coupled to the image sensing unit 
102", and controls the integration time of the same in 
a known manner. The image sensing unit 102" generates 

20 input optical image signals corresponding to the optical 
image input sensed thereby . In the set-up mode , the video 
amplifier 1060" amplifies the input optical image 
signals from the image sensing unit 102" . The ADC 1402" , 
which is coupled to the video amplifier 1060", receives 

25 the optical image signal output of the latter, and 
proceeds to convert the same into digital form. The 
optical image data from the ADC 14 02" is received by 
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the image processor 122" . Thereafter, the image 
processor 122" analyzes the light level coordinate 
distribution of image pixel data that constitute the 
optical image data from the ADC 1402" . Based on the light 

5 level coordinate distribution analyzed thereby, for 
light level coordinates distributed with a number of 
image pixel data that is above a predetermined light 
level threshold number (N t h) r the image processor 122" 
determines an upper range limit (Riu-0 of a highest 

10 dynamic range portion (Ri<0 of a wide input dynamic range 
of the optical image input, and a lower range limit (R2D") 
of a lowest dynamic range portion (R2O of the wide input 
dynamic range of the optical image input, as shown in 
Figure 7. The image processor 122" then determines a 

15 lower range limit (Rid-) of the highest dynamic range 
portion (Ri«) by inspecting successive ones of the light 
level coordinates in a descending order starting from 
the upper range limit (Riu") until a light level 
coordinate distributed with a number of image pixel data 

20 that is below the predetermined light level threshold 
number (N t h) is detected. The image processor 122" 
further determines an upper range limit (R2U") of the 
lowest dynamic range portion (R 2 ») by inspecting 
successive ones of the light level coordinates in an 

25 ascending order starting from the lower range limit (R 2 d*) 
until a light level coordinate distributed with a number 
of image pixel data that is below the predetermined light 
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level threshold number (N t h) is detected. 

In the event that the total number of image pixel 
data having light levels that fall in either one of the 
highest and lowest dynamic range portions (Ri«, R 2 0 fails 
5 to encompass a predetermined pixel threshold number, 

e.g. 90% or more of the total number of image pixel data 
from the ADC 142", for light level coordinates 
distributed with a number of image pixel data that is 
above the predetermined light level threshold number 
10 (Nth) and not belonging to the highest and lowest dynamic 
range portions (Ri«, R2") / the image processor 122" then 
determines an upper range limit (R 3 ir) of a second-highest 
dynamic range portion (R 3 «) of the wide input dynamic 
range of the optical image input, and a lower range limit 
15 (R4D") of a second-lowest dynamic range portion (R 4 -) 

of the wide input dynamic range of the optical image 
input, as shown in Figure 7. The image processor 122" 
subsequently determines a lower range limit (R3D") of 
the second-highest dynamic range portion (R 3 -) by 
20 inspecting successive ones of the light level 
coordinates in a descending order starting from the upper 
range limit (R 3 u") until a light level coordinate 
distributed with a number of image pixel data that is 
below the predetermined light level threshold number 
25 (Nth) is detected. The image processor 122" further 
determines an upper range limit (R4U") of the 
second- lowest dynamic range portion (R 4 0 by inspecting 
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successive ones of the light level coordinates in an 
ascending order starting f romthe lower range limit (R 4 dO 
until a light level coordinate distributed with a number 
of image pixel data that is below the predetermined light 

5 level threshold number (N t h) is detected. Whether or 
not third-highest, third-lowest, fourth-highest, 
fourth-lowest, fifth-highest and fifth-lowest dynamic 
range portions are to be determined by the image 
processor 122" depends on whether the total number of 

10 image pixel data having light levels that fall in any 
determined one of the dynamic range portions of the wide 
input dynamic range of the optical image input 
encompasses the predetermined pixel threshold number . 
In the example of Figure 7, the total number of image 

15 pixel data in the highest, second-highest, lowest and 
second-lowest dynamic range portions encompasses the 
predetermined pixel threshold number, and there is no 
need to determine the range limits of the third-highest, 
third-lowest , fourth-highest , fourth-lowest , 

20 fifth-highest and fifth-lowest dynamic range portions. 

Upon determining the range limits of the different 
dynamic range portions (Ri*, R 2 */ R3"/ R4"/ -« etc.), the 
image processor 122" stores range information 
associated with the different dynamic range portions 

25 (Ri*/ R2", .» etc.) in the data storage unit 124. 

After operation in the set-up mode, the imaging 
apparatus is now ready to be operated in an output 



image-generating mode. In the output image-generating 
mode, the optical imaging lens 100" will provide an 
optical image input of a scene. The image sensing unit 
102" receives the optical image input from the optical 
imaging lens 100" and, under the control of the timing 
controller 120", generates input optical image signals 
corresponding to the optical image sensed thereby. The 
input optical image signals are provided to the video 
amplifiers 1060", 1061", ... 106n" simultaneously. Based 
on the range information stored in the data storage unit 
124" , the bias and gain settings of the video amplifiers 
1060" , 1061" , ... 106n" are adjusted by the image processor 
122" such that the output of the video amplifier 1060" 
has a dynamic range corresponding to the highest dynamic 
range portion (Ri») , such that the output of the video 
amplifier 1061" has a dynamic range corresponding to 
the second-highest dynamic range portion (R 3 <0 , such 
that the output of the video amplifier 1062" has a dynamic 
range corresponding to the second- lowest dynamic range 
portion (R 4 0 , and such that the output of the video 
amplifier 1063" has a dynamic range corresponding to 
the lowest dynamic range portion (R 2 -) • The operations 
of theADCs 1402", 1412", ... 14n2", the image buff er units 
1406" , 1416" , 14n6" , and the image combining device 18" 
are similar to those of the ADCs 142, 162, the image 
buffer units 146, 166 and the image combining device 
18 of the first preferred embodiment, and will not be 



detailed further for the sake of brevity. 

The fourth preferred embodiment of an imaging 
apparatus according to the present invention has a 
structure similar to that of the third preferred 
embodiment , the maindif f erence residing inhow the image 
processor 122" (see Figure 6) of the fourth preferred 
embodiment segregates the wide input dynamic range of 
an optical image input into the different dynamic range 
portions . 

In the fourth preferred embodiment, when the imaging 
apparatus is operated in the set-up mode, the image 
processor 122" analyzes the light level coordinate 
distribution of image pixel data that constitute the 
optical image data received thereby. Based on the light 
level coordinate distribution analyzed thereby, for 
light level coordinates distributed with a number of 
image pixel data that is above a predetermined light 
level threshold number (Nth) / the image processor 122" 
determines an uppermost range limit (Riu") of the wide 
input dynamic range of the optical image input, and a 
lowermost range limit (R 2 d-') of the wide input dynamic 
range of the optical image input, as shown in Figure 
8. The image processor 122" then determines a first 
non-significant dynamic range portion (Rdi* § ) between 
the uppermost and lowermost range limits (Riu w ' ) / (R2D-') • 
The first non- significant dynamic range portion (R D i*") 
is a dynamic range portion of the wide input dynamic 
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range of the optical image input that encompasses a 
greatest number of consecutive light level coordinates 
distributed with a number of image pixel data that is 
below the predetermined light level threshold number 
5 (N t h) . If/ after deducting the number of image pixel 

data having light levels that fall in the first 
non- significant dynamic range portion (R D i<") from the 
total number of image pixel data between the uppermost 
and lowermost range limits (Riu- / R2D" ) / the remaining 
10 number of image pixel data is larger than a predetermined 
number, the image processor 122" then determines a second 
non-significant dynamic range port ion (R D 2-) of the wide 
input dynamic range of the optical image input between 
the uppermost and lowermost range limits (Riu*" / R2D" ) 
15 and encompassing a second greatest number of consecutive 
light level coordinates distributed with a number of 
image pixel data that is below the predetermined light 
level threshold number (N t h) - Whether or not third to 
ninth dynamic range portions are to be determined by 
20 the image processor 12 2" depends on whether the remaining 
number of image pixel data is larger than the 
predetermined number. In the example of Figure 8 , because 
the remaining number of image pixel data between the 
uppermost and lowermost range limits (Riu"' / R2D" ) after 
25 deducting the total number of image pixel data in the 

first to fourth non-significant dynamic range portions 
(R D i-*f Rd2--, Rd3--, Rd4<-) is not larger than the 
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predetermined number, there is no need to determine the 
fifth to ninth non-significant dynamic range portions. 
Upon determining the different non-significant 
dynamic range portions (R D i"' , Rd2"'/ &d3"'/ Rd4"'/ — R-Dn-i"') # 

5 the image processor 122" is able to determine the range 
limits of n dynamic range portions, and stores range 
information associated with the different dynamic range 
portions in the data storage unit 124" ' . 

The operation of the fourth preferred embodiment in 

10 the output image -generating mode is similar to that of 
the third preferred embodiment and will not be detailed 
further for the sake of brevity. 

A main advantage arising from the use of the imaging 
apparatus of this invention resides in that , in the event 

15 that back light conditions exist or part of the image 
is under strong light and another part of the image is 
under the shade, an output image of relatively good 
quality can be obtained even without the use of a flash 
or other light compensating devices. In addition, the 

20 output image can be generated using a single optical 
imaging lens during a single exposure. The imaging 
apparatus of this invention can thus be used to generate 
images of a fast moving object. 

While the present invention has been described in 

25 connection with what is considered the most practical 
and preferred embodiments, it is understood that this 
invention is not limited to the disclosed embodiments 
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but is intended to cover various arrangements included 
within the spirit and scope of the broadest 
interpretation so as to encompass all such modifications 
and equivalent arrangements. 



